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[57] ABSTRACT 

A television presentation and editing system uses closed 
captioning text to locate items of interest. A closed caption- 
ing decoder extracts a closed captioning digital text stream 
from a television signal. A viewer specifies one or more 
keywords to be used as search parameters. A digital proces- 
sor executing a control program scans the closed captioning 
digital text stream for words or phrases matching the search 
parameters The corresponding segment of the television 
broadcast may then be displayed, edited or saved. In one 
mode of operation, the television presentation system may 
be used to scan one or more television channels unattended, 
and save items which may be of interest to the viewer. In 
another mode of operation, the system may be used to assist 
editing previously stored video by quickly locating seg- 
ments of interest. 

11 Claims, 12 Drawing Sheets 
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APPARATUS AND METHOD FOR 
SELECTIVELY VIEWING VIDEO 
INFORMATION 

RELATED APPLICATIONS 

This is a divisional of application Ser. No. 08/452,441, 5 
filed May 26, 1995, now U.S. Pat. No. 5,561,457 which is 
a divisional of application Ser. No. 08/103,023, filed Aug. 6, 
1993, which issued as U.S. Pat. No. 5,481,296 on Jan. 2, 
1996. 

10 

FIELD OF THE INVENTION 
The present invention relates to television and other video 
information, and in particular to a novel method and appa- 
ratus for selectively viewing television or other video sig- 
nals. 15 

BACKGROUND OF THE INVENTION 

Television has become the world's predominant commu- 
nications medium. The variety of programming available on 
television has mushroomed in recent years with the growth 2 q 
of cable networks In many areas, a viewer can select 
programming from among dozens of channels, broadcasting 
news, talk shows, movies, soap operas, serials, etc., from 
Geraldo Rivera to William F. Buckley, from the banal to the 
sublime (or the reverse, depending on one's point of view). 2 s 

Although a large amount of information is broadcast via 
television, the capability to selectively view television is 
primitive. Published television listings typically contain a 
minimal amount of information about the program to be 
shown, are often difficult to understand, and are subject to 30 
frequent errors and changes. Furthermore, a certain amount 
of television programming, such as a news broadcast, by its 
nature can not be described in advance. 

Most viewers would like greater control over what is 
being viewed. They may, for example, wish to view specific 35 
portions of a news program or a talk show dealing with a 
topic of interest. They may wish to monitor multiple chan- 
nels simultaneously. They may wish to screen out program- 
ming they regard as offensive. 

In theory, a viewer could record one or more television 40 
signals on one or more recording devices, such as commonly 
available video cassette recorders (VCRs), and review all 
recorded signals, editing such portions as desired. In reality, 
this would be an extremely tedious and time consuming task. 

There has been some recognition of a need to provide a 45 
viewer with greater control over what is being watched. For 
example, it is known in the art to place a small window in 
one corner of the television display, in which is shown the 
video signal of another broadcast channel, enabling the 
viewer to screen one channel while simultaneously watching 50 
another. As helpful as this feature is to the viewer, it is 
obviously limited in its capabilities. Screening multiple 
channels would require a separate window for each one. The 
screening must he done at the time the signal is broadcast. 
If something of interest is detected, the channel must be 55 
switched, possibly foregoing programming of interest on the 
channel first being viewed. 

Television viewers have accepted this lack of ability to 
screen, preview or extract portions of television program- 
ming only because no alternative has been presented. 60 
However, a need exists for advanced capability on the part 
of the viewer to selectively control what is viewed. 

SUMMARY OF THE INVENTION 
It is therefore an object of the present invention to provide 65 
an enhanced method and apparatus for viewing video infor- 
mation. 
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Another object of this invention is to increase the ability 
of a user of video information to control the content of the 
video presentation. 

Another object of this invention is to provide an enhanced 
method and apparatus for using televised information. 

Another object of this invention is to increase the ability 
of a user of video information to find and view desired 
information. 

Another object of this invention is to increase the ability 
of a viewer of televised information to locate information of 
interest from among a plurality of channels and/or programs. 

Another object of this invention is to increase the ability 
of a user of video information to screen out material which 
the user considers offensive or undesirable. 

Another object of this invention is to provide and 
enhanced method and apparatus for using information in a 
vertical blanking interval of a video signal to find video 
matter of interest. 

In accordance with the preferred embodiment of the 
present invention, the information carried in the closed 
captioning portion of a television signal is extracted and 
searched to find programming of interest to a viewer. The 
viewer can then view an entire program segment or edit 
segments. 

A conventional television signal comprises video and 
audio components. The video component of the signal is 
capable of carrying additional information during a "vertical 
blanking interval". In particular, the vertical blanking inter- 
val is used to carry closed captioning information, which is 
a text stream. Typically, this closed captioning information 
is a simplified version of the spoken words being transmitted 
by the audio portion of the signal. While not a perfect 
representation of what is being depicted by the television 
presentation, the closed captioning text will generally con- 
tain words descriptive of a plot, news, or other information 
being carried by the television signal. 

A video presentation system in accordance with the 
preferred embodiment of the present invention comprises a 
suitably programmed general purpose digital computer, a 
television signal receiver/tuner, a closed captioning text 
decoder, and a mass storage for storing television signals, 
which could be a conventional video cassette recorder, a 
large direct access storage device, or other data storage. 

A television viewer inputs to the presentation system one 
or more key words to be used as search parameters. These 
may be input simply as an unordered set of words, or logical 
relations such as "AND", "OR", etc, may be specified as 
known in the art of computer database searching. The 
computer stores these key words and their required logical 
relationships. The viewer also directs the presentation sys- 
tem to monitor specified channels at specified times. 

The television receiver/tuner receives television signals 
for the specified channel or channels. The closed captioning 
portion of the television signal is extracted by the closed 
captioning text decoder and converted to R digital stream of 
textual data. The computer then scans the closed captioning 
textual data stream extracted from the video signal for 
occurrences of words matching its search parameters. 

In a scan mode of operation, scanning is done while the 
television signal is being received. When a match is found, 
the corresponding segment of the television signal (video 
and audio portions) is saved in the mass storage for later 
viewing. In other modes of operation, the system scans the 
closed captioning stream of a pre-recorded signal for a 
match of the search parameters, 
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What is done with a segment or interest once it has been 
located will depend upon the desires of the viewer. The 
viewer may, for examples specify the size of a segment, 
which could be a relatively short interval (e.g., 15 seconds) 
before and after the occurrence of the search term, as might 5 
be useful for a news broadcast, or could be a much longer 
interval such as an entire X A hour television program. The 
viewer may wish to watch any segments which were found, 
or may wish to edit and save segments for later viewing. The 
viewer may wish to edit out small segments of a larger 10 
presentation, e.g., where the viewer finds such segments 
offensive. The system may display to the user all or part of 
the extracted textual data from the segments, and permit the 
user to select those segments to be viewed and/or edited. 

BRIEF DESCRIPTION OF THE DRAWINGS 15 

FIG, 1 is a block diagram of the major components of a 
video presentation system according to the preferred 
embodiment of this invention; 

FIG. 2 shows in greater detail the major components of 20 
the computer portion of the video presentation system 
according to the preferred embodiment; 

FIG, 3 shows in greater detail the structure of the video 
segment buffer according to the preferred embodiment; 25 

FIGS. 4A, 4B, 4C, 4D, and 4E show the format of scan 
profile data structures according to the preferred and alter- 
native embodiments; 

FIG. 5 is an example of how a complete set of profile data 
structures would be used to specify a typical scan for data of 30 
interest according to the preferred and alternative embodi- 
ments; 

FIG. 6 shows the high level flow of control of the control 
program according to the preferred embodiment; 

FIG. 7 shows the steps performed by control program 220 35 
as part of the edit profile function according to the preferred 
embodiment; 

FIGS. 8 A and 8B show the steps required to scan a 
received signal for items of interest according to the pre- 4Q 
ferred embodiment; 

FIG. 9 shows the steps required to determine whether a 
sequence of words in a log of closed captioning text matches 
the search parameters specified by the profile data structures 
according to the preferred embodiment; 45 

FIG. 10 shows the steps required to search and edit a 
signal according to the preferred embodiment, 

DETAILED DESCRIPTION OF THE 

PREFERRED EMBODIMENT 5Q 

FIG. 1 shows a block diagram of the major components 
of a video presentation system according to the preferred 
embodiment of the present invention. Video presentation 
system 100 comprises digitally controlled receiver/tuner 
101, signal splitter 102, closed captioning text decoder 103, 55 
general purpose digital computer system 104, mass storage 
105, video display 106 and audio speaker 107. Receiver/ 
tuner 101 receives an analog television signal from an 
external source, such as an antenna for receiving atmo- 
spheric television transmissions, a coaxial transmission 60 
cable from a cable television network, or a video cassette 
recorder. Receiver/tuner 101 receives commands to tune in 
one or more channels from computer 104 via control line 
111. Receiver/tuner 101 demodulates the signal received on 
a specified channel and outputs the demodulated signal on 65 
line 112 to splitter 102. The signal is fed simultaneously 
from splitter 102 into computer 104 and closed captioning 
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text decoder 103 via lines 113,114. Closed captioning 
decoder 103 extracts a stream of textual data from the video 
signal. This extracted stream is forwarded to computer 104 
in digital format on serial digital line 115. Optional speech 
recognition unit 130 may also be used to provide additional 
textual data as explained with reference to an alternative 
embodiment. 

Closed captioning decoder 103 is preferably a decoder 
constructed to convert information contained in line 21 of 
the vertical blanking interval of a television signal to a text 
stream. Normally, this information is a modified represen- 
tation of spoken text being carried in the audio portion of the 
television signal, and is intended for use by hearing impaired 
persons. Standards for such devices are specified in 47 
C.F.R. 15.119, herein incorporated by reference. Additional 
information relating to closed captioning decoders is con- 
tained in Lentz et al., "Television Captioning for the Deaf 
Signal and Display Specifications'* (Public Broadcasting 
Service, 1980), incorporated herein by reference as addi- 
tional background information. 

In the preferred embodiment, receiver/tuner 101 is an 
IBM PS/2 TV. Computer 104 is an IBM PS/2 personal 
computer. It should be understood that other hardware 
performing similar function could be used in place of that 
specified here, in particular any of various commercially 
available video function cards which plug into available 
slots of a personal computer. 

FIG. 2 shows in greater detail the major components of 
computer portion 104 of video presentation system 100. 
Computer 104 comprises central processing unit (CPU) 202, 
random access memory 203, mouse port controller 204, 
keyboard port controller 205, serial communications con- 
troller 206, digital video capture 207, graphic display card 
208, audio driver 209 and storage controller 210, all coupled 
to bidirectional system communications bus 201. Bus 201 
facilitates communications, i.e. transfer of data, among the 
various components of computer 104. 

CPU 202 is a general purpose programmable processor 
such an an Intel 80486 processor commonly used in personal 
computers. Memory 203 is a random access memory suffi- 
ciently large to hold the necessary programming and buffer 
data. While memory 203 is shown as a single entity, it should 
be understood that memory 203 may in fact comprise a 
plurality of modules, and that memory may exist at multiple 
levels, from high-speed registers and caches to lower speed 
but larger DRAM chips. As shown in FIG. 2, memory 203 
contains control program 220, data structures 221, and 
buffer 222. Control program comprises a plurality of 
machine instructions which execute on processor 202 to 
perform video selection, scanning and editing functions as 
described more fully herein. Data structures 221 comprise 
data which direct and customize the operation of control 
program 220, such as user time and channel selections, 
search parameters, locations of video segments of interest, 
etc. Buffer 222 is used for temporary storage of video signals 
or closed captioning data during scanning and editing by 
control program 220. 

Mouse port controller 204 and keyboard port controller 
205 facilitate input of data by the viewer from either a mouse 
or keyboard. In the preferred embodiment, keyboard 120 
attaches to PS/2 TV 101, and keyboard signals pass through 
it. However, it is also possible to couple a keyboard directly 
to keyboard port 205. Controllers 204 and 205 are illustra- 
tive of the type of input controller commonly used for 
personal computers, it being understood that it would be 
possible to use other forms of input devices, such as 
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joysticks, trackballs, infra-red hand-held remote control buffer; the actual numerical address in the segment pointer 

units, or even speech recognition devices. may be increased or decreased. While FIG. 3 shows a buffer 

Serial communications controller 206 comprises a con- navin S 12 segments, it should be understood that the number 

ventional universal asynchronous receiver/transmitter and si f of ,he !?S ments J"* and '"P^ 1 *»' 

(UART), for handling serial communications with closed 5 control program 220 may dynamically vary the number and 

captioning decoder 103 over serial digital line 115. While s * e f »gment«. ™ e des.gn and operauon of such 

. ii ■ , , i-l-j. i circular buffers is known m the art of computer program- 
controller 206 is capable of bidirectional communications, 

in general it only receives digital data from decoder 103. ""I!™ AA ATi Ar , Arx , Ar , ... t 

However, it may be used to transmit commands to decoder FIGS^4A, 4B, 4Q 4D and 4E show me format of the scan 

103, e.g., to re-try a communication. 10 Profile data structure which is used to record what type of 

^. . , _ . ^ M . . , television mformation the viewer wishes to identify, and to 

Digital video capture unit 207 is a circmt card and ^ tion of ffl 220 £ach fiJe 

components which receive analog video and audio signals record indudes 0Qe file comrol bbck 401 ^ shown fa 

over line 114 and convert these signals to a digital format mQ 4A profi]e Wock ^ fc ^ ^ fik recofd 

suitable for storage and manipulation by digital computer and ^ wMch im tQ subsidi records . 

^ , T ^ n1, ? 1Slt >fi ° ra ? tU / C Umt ^file control block 401 comprises title field 402, which 

207 is an IBM ActionMedia II Display Adapter with Action- a shon ^ Qf ^ profile for uge ^ yiewer ideQti _ 

Media II capture option. ficadon DeS cription field 403 contains a longer textual 
Graphic display card 208 transmits outgoing video signals description of the subject of the profile. Interval field 404 
to receiver/tuner 101 over line 116, and ultimately to video 2Q determines the size of an interval to be saved and recorded, 
display screen 106. Display card 208 receives digital signals u spec ifies the number of seconds of television signal to be 
on bus 201 and converts these to an RGB analog format or save d recorded before and after encountering a match of 
composite video analog format, suitable for receiving by tnc search parameters. Next profile pointer field 405 and last 
display screen 106. Audio driver 209 simultaneously trans- pro fi le pointer field 406 contain pointers to the next and 
mits the audio component of the television signal to speaker 25 previous profile control blocks, respectively. It is expected 
1^7. that the video presentation system of the present invention 
Storage controller 210 communicates with mass storage may store multiple profiles, and that these would be stored 
device 105. In the preferred embodiment, mass storage as one or more circular linked lists of variable length, as are 
device 105 is an IBM PS/2 External Disk Array Subsystem. known in the art of computer programming. Time pointer 
Such a device comprises a plurality of rotating magnetic 30 field 407 contains a pointer to the first time control block 410 
disk drive storage devices, which are controlled by a single to which the profile applies. Time control blocks 410 are 
controller to act as a single large storage entity. Mass storage maintained as a linked list of variable length, allowing a 
device 105 functions primarily as a buffer for storage of single profile to specify multiple time periods during which 
video and audio signals which have been digitized by channels should be scanned for television of interest. Key- 
capture unit 207. Due to the large volume of storage such 35 word pointer 408 contains a pointer to the first OR-ed key 
digitized signals consume, a large external storage device is word control block 430. Keywords are also maintained as a 
preferably employed. While only one such unit is shown, it variable length linked list, permitting multiple keywords and 
should be understood that there may in fact be multiple mass combinations of AND-OR logic, as illustrated below in 
storage devices, which may be internal or external to com- respect to FIG. 5. 

puter 104. Typically, computer 104 will include an internal 40 The format of time block 410 is shown in FIG. 4B. Each 

disk drive of smaller capacity than the external disk drive time block 410 specifies a time period during which appli- 

array subsystem 105, on which may be stored, e.g., pro- cable channels should be scanned for items of interest. Date 

grams required for operation of computer 104 in accordance or day field 411 specifies a date or day of the week for the 

with the present invention or other data. It should also be start of the scanning period, This may be specified either as 

understood that other forms of mass storage for video 45 a single date, in which case the scan will be performed only 

signals may be employed. In particular, it would be possible 0 oce, or as a day of the week, in which case the scan will be 

to store analog video signals on one or more conventional performed every week at the same time. Date or day field 

video cassette recorders. 411 ma y also contain a special code designating "Monday 

FIG. 3 shows in greater detail the structure of buffer 222. through Friday" or other common combination of days, 

Buffer 222 is part of a larger general purpose RAM 203. A 50 indicating that the scan is to be performed on all such days, 

portion of RAM 203 is allocated to buffer 222 upon initial- Start time field 412 specifies the time of day at which the 

izing a certain functions as described more fully herein. scan is to begin. Time end field 413 specifies the time at 

Buffer 222 is allocated in a plurality of segments 301-312, which the scan ends. Next time pointer 414 contains a 

which may or may not be contiguous in RAM 203. Each pointer to the next time control block 410 in the list of time 

buffer segment is capable of holding a television signal 55 control blocks for the applicable profile. A null value indi- 

segment from a short time period in its respective data field cates that the end of the list has been reached. Channel 

323. Each buffer segment 301-312 also contains a respective pointer 415 contains a pointer to the list of channels to be 

pointer field 321, containing a pointer to the beginning of the scanned. 

next segment, and a respective save field 322, containing a The format of channel block 420 is shown in FIG. 4C. 

flag indicating whether the segment should be saved to 60 Channel block 420 is used only if multiple channel scanning 

storage. Segment pointer 325 in data 221 points to current is supported. Where the system is capable of scanning only 

segment 305. Buffer 222 is preferably arranged as a circular one channel at a time, there is no need for a pointer to a list 

buffer. Segment pointer 325 is "incremented" periodically as of channels, and field 415 of time block 410 may instead 

required to point to the next segment. After the last segment contain simply the single channel to be scanned. Where 

is reached, the pointer is "incremented" to point to the first 65 multiple channels may be scanned, provision is made for a 

segment again. As used herein, "incremented" refers to the variable length list of channels. Channel block 420 contains 

fact that the pointer is set to the next segment in the circular channel field 421, which identifies a channel to be scanned, 
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and next channel pointer field 422, which contains a pointer scanned during the time period specified by time block 510. 

to the next channel control block on the list. The final Next channel pointer field 422 points to channel block 512. 

channel block on the list contains a null pointer in field 422. This channel block contains a different channel (channel 3) 

The formats of OR-ed keyword block 430 and AND-ed ( o be scanned during the same time period. Next channel 

keyword block 440 are shown in FIGS. 4D and 4E respec- 5 pointer field 422 of block 512 contains a null pointer, 

tivcly. These blocks effectively specify the search param- indicating the end of the list of channels to be scanned at this 

eters to be used when scanning for television data of interest. time - Thus, blocks 510, 511 and 512 together specify that 

In accordance with the preferred embodiment, a user may channels 10 and 3 should be scanned every weekday from 

specify one or more disjunctions of conjunctions of key- 5:00 pm to 6:30 pm. 

words. I.e., a user may specify a search of the form 10 Next time pointer field 414 of time block 513 specifies 

(WORD1 and WORD2) or (WORD3 and WORD4 and another time period to be scanned. As in the case of time 

WORDS) or (WORD6) or . . . The number of disjunctions block 510 described above, time block 513 points to channel 

is variable, as is the number of conjunctions which make up block 514, which in turn points to block 515. These collec- 

each disjunction. OR-ed keyword block 430 comprises next tively specify that channels 10 and 3 are to be scanned every 

OR-ed pointer field 431, which points to the next OR-ed 15 weekday from 10:00 pm to 10:30 pm. Although the strings 

keyword block of the disjunctive string; keyword 432 which of blocks starting at 511 and 514 are shown separately in 

contains a keyword to be matched; and next AND-ed pointer FIG. 5 for clarity, it should be understood lhat they may in 

field 433, which contains a pointer to an AND-ed keyword fact be a single string of channel blocks, which is pointed to 

block 440 which is part of the conjunctive string. ANDed by both time blocks 510 and 513. 

keyword block 440 comprises number words within field 20 Ncxt time pointer field 414 of time block 513 points t0 

441, which specifies a maximum distance in terms of t i me block 516, which specifies still another time period to 

number of words between words in a conjunctive string, I.e., be scanned. Block 516 specifies a scan on Saturday and 

the words of a conjunctive string must be within a specified Sunday, from 8:00 am to 11:00 pm. Next time pointer field 

proximity of each other to create a true match. ANDed 414 0 f block 51 fi ^ null> indicating the end of the string of 

keyword block 440 further comprises keyword field 442, 25 time bk)cks 51Q and 516 Cnannel pointer field 415 of 

which specifies a keyword, and next ANDed pointer 443, block $16 points to channel block 517, which specifies 

which points to the next ANDed keyword block 440 of the channel 4. Channel block 517 points to channel block 518, 

string. Nulls in pointer fields 431,433,443 indicate the last which in turn points to channel block 519, specifying a list 

word of the string. 0 f mree channels, channels 4, 5 and 6, to be scanned during 

FIG. 5 is an example of how a complete set of profile data 30 the time period specified by time block 516. 
structures 401, 410, 420, 430, 440 would be used to specify Keyword pointer field 408 of profile control block 501 
a typical scan for data of interest. In this example, the profile po i nts t0 tne fi ret 0 R-cd keyword block 520. OR-ed key- 
is established to scan for news about the Minnesota Twins wor d block 520 contains the keyword "Minnesota" in key- 
baseball team. It is desired to scan local channels 3 and 10 worc j g elc i 432, and contains a pointer to AND-ed keyword 
during the periods of normal local newscasts on weeknights, block 521 in next AND-ed ptr field 433. AND-.ed keyword 
and to scan major network channels 4, 5 and 6 all weekend block 521 contains the keyword "Twins" in keyword field 
for items about the Minnesota Twins. 442, and contains the number 2 in field 441, specifying the 

In the example of FIG. 5, reference number 501 repre- maximum distance of the keywords. Next ANDed pointer 

sents a profile control block having the same structure as 4Q field 443 of block 521 is null, indicating the end of the string 

profile control block 401 shown in FIG. 4A. Reference of ANDed keywords. Blocks 520 and 521 together specify 

numbers 510, 513 and 516 each represent a time block a search for the keywords "Minnesota" and "Twins", and 

having the same structure as time block 410 shown in FIG. specify that these words must be within two words of each 

4B. Reference numbers 511, 512, 514, 515, 517, 518 and other in a text string, This, the text "Siamese twins were born 

519 each represent a channel block having the same struc- 4S at Take Wobegone, Minn." would not satisfy the search 

ture as channel block 420 shown in FIG. 4C. Reference parameters specified by blocks 520 and 521 because the 

numbers 520 and 522 each represent an OR-ed keyword words "twins" and "Minnesota" are more than two words 

block having the same structure as OR-ed keyword block apart in the string, whereas "The Minnesota Twins lost to 

430 shown in FIG. 4D. Reference numbers 521 and 523 each Kansas City last night" would satisfy the search parameters, 

represent an AND-ed keyword block having the same struc- 5Q Typically, closed captioning text is in all capital letters; 

ture as AND-ed keyword block 440 shown in FIG. 4E. (he sample text above is shown in mixed case for ease of 

As noted earlier, the complete set of profile data for this understanding. However, even if text is presented in mixed 

scan contains one profile control block 501. Title field 402 case, the search parameters are preferably not case sensitive, 

of block 501 contains the title "Twins", and description field i.e., search words match regardless of whether the letters are 

contains the string "MN Twins Baseball News". These fields 55 upper or lower case. 

are useful in identifying the nature of the profile. Next and N ext OR-ed pointer field 431 of block 520 points to block 

Last profile pointer fields 405,406 point to additional profile 522, which specifies another string of keywords. Block 522 

control blocks (not shown) having the same structure as contains the keyword "Twins*' in keyword field 432, and a 

profile control block 401, which are used to find unrelated pointer to AND-ed keyword block 523 in field 433. AND-ed 

items of interest. 60 keyword block 523 contains the keyword "Baseball" in field 

Time block pointer field 407 points to the first time block 442, and the keyword distance 30 in field 441. A null pointer 

510 of a string of time blocks. In this example, the first time in field 443 of block 523 indicates the end of the conjunctive 

block 510 is used to specify the time period from 5:00 pm string, Blocks 522 and 523 collectively specify a search for 

to 6 :30 pm on weekdays, This time period corresponds to the the keywords "Twins" and "Baseball.", which must be 

time for typical local newscasts. Channel pointer field 415 of 65 located within 30 words of each other in a text string. Next 

block 510 points to channel block 511. Channel field 421 of OR-ed pointer field 431 of block 522 is null, indicating the 

channel block 511 contains a channel (channel 10) to be end of the string of OR ed keyword blocks (disjunctive 
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string). In this example, two separate and independent 
(disjunctive) conditions are specified, the first by blocks 
520-1, the second by blocks 522-3. If a decoded closed 
captioned text string satisfies either condition, the search 
parameters are said to be satisfied and appropriate action 
will be taken to save or otherwise deal with the video 
interval in which the string satisfying the search parameters 
was found, as more fully described below. 

The operation of the present invention in the preferred 
embodiment will now be described. Control program 220 is 
the heart of the operation, and controls computer 104 and 
other hardware shown in FIG. 1. Control program 220 
comprises four basic functions: a set profile function, a 
capture function, a scan function, and a review/edit function. 

In order to perform certain functions, control program 220 
requires interactive input of the viewer. Video . presentation 
system 100 preferably displays prompts, lists of choices, and 
other required information on display 106, Information in 
text form required for viewer selections may be overlayed 
on any video picture being displayed on display 106, per- 
mitting the viewer to interactively input information while a 
television program is simultaneously being displayed on 
display 106. Apparatus for overlaying such textual informa- 
tion is known in the art. Alternatively, it would be possible 
to display such textual information on display 106 by itself, 
without any other video picture, or in a window of display 
106 while a television program is being shown on the 
remainder of the display, or on a separate special purpose 
display, such as a small light emitting diode (LED) display. 

FIG. 6 shows the high level flow of control of control 
program 220. Upon power first being applied to video 
presentation system 100, control program 220 enters idle 
mode at block 601. Control program 220 waits in idle mode 
until the user demands attention, as for example, by pressing 
an appropriate function key on keyboard 120, or a button on 
mouse 121 (block 602). Control program responds by dis- 
playing a menu of available choices on display 106 or a 
special purpose display, as explained above, at block 603, 
The available choices are to edit a profile (block 610), to 
scan incoming television signals in accordance with a profile 
(block 611), to search and edit a stored video signal (block 
612), and to capture and save incoming television signals for 
later viewing and/or editing (blocks 620-23). The user may 
also choose to return to idle mode (block 613). The user 
selects one of the available choices, and upon completion of 
the selection, control program 220 either returns to idle 
mode or to the menu of choices, as illustrated. The steps 
required to perform the edit profile, scan, and search/edit 
video functions (blocks 610-612) are explained in greater 
detail below with reference to FIGS. 7-10. 

To perform the capture and save function, the video 
presentation system must be instructed as to the time interval 
and channels) to be captured and saved. When this option 
is selected, control program presents the viewer with a list 
of available profiles to select at block 620. These profiles 
specify channels) and time(s) for capture of the signal. The 
viewer may optionally specify R channel and start and stop 
times, without creating a profile. Upon receiving the view- 
er's selection, control program 220 waits at block 621 until 
the specified start time for video capture. At the start time, 
control program 220 captures the video and text, I.e., it 
commands digital tuner 101 to tune the appropriate channel., 
and instructs video capture unit 207 to receive and digitize 
the analog signal from tuner 101 and send it directly to 
storage controller 210 via bus 201 to be stored in storage 105 
(block 622). At the same time, decoder 103 decodes closed 
captioning data, which is received by serial UART 206 and 
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also stored directly in storage 105 (block 623). At the end of 
the specified capture period, control program 220 returns to 
idle mode. The television signal thus digitized and stored 
can be later edited using the search/edit function, or simply 

5 played back. 

FIG. 7 shows the steps performed by control program 220 
as part of the Edit Profile function. The Edit Profile function 
allows a viewer to create or alter a profile data structure. The 
profile data structure specifies such things as channels and 

10 times to be monitored, size of capture windows, key words 
used and search parameters and logical relationships 
between these key words, etc., as explained above. When a 
viewer selects the set profile function, e.g. by keyboard 120 
or mouse input device 121, monitor program 220 displays a 

15 menu of available choices, which include to create a new 
profile from scratch, to edit an existing profile, or to copy an 
existing profile as a template for creating a new profile. If the 
user elects to create a new profile from scratch, control 
program 220 prompts the easer to enter the new profile name 

20 at block 701. It then creates the new profile data structures 
explained above and depicted in FIGS. 4A— 4E, and enters 
default values in the appropriate fields, at block 702. If the 
user elects to edit an existing profile, control program 220 
displays a list of existing profiles and receives the user's 

25 selection at step 703. If the user elects to copy an existing 
profile as a template, control program 220 displays the list 
of existing profiles and receives the user's selection at step 
704. It then creates new profile data structures as depicted in 
FIGS. 4A-4E, and copies the values from the selected 

30 profile into the new profile data structures, at step 705. 
Program 220 then prompts the user to enter the name of the 
new profile, in order to distinguish it from the profile from 
which it was copied, at step 706. 

Upon completing the initial creation, selection or copying 

35 of a profile as explained above, control program 220 dis- 
plays the profile values at step 710. The user may then select 
any of various editing options. The user may add an element 
(block 711), as for example adding a time period to be 
scanned or adding a search word. The user may delete such 

40 an element (block 712). The user may change such an 
element (block 713). Each time the user adds, deletes or 
changes an element, control program returns to block 710 to 
display the altered profile. The user may also delete an entire 
profile, which would delete all associated data structures 

45 depicted in FIGS. 4A-4E (block 714). When done editing, 
the user chooses to end the editing function (block 715). 

In accordance with the preferred embodiment, the video 
presentation system can operate in automatic scan mode to 
automatically find and record television signals of interest 

50 without a human operator's attendance during signal 
reception, FIGS. 8 A and, 8B illustrate the operation of the 
presentation system while in automatic scan mode. More 
particularly, FIGS. 8 A and 8E illustrate the steps performed 
by control program 220 executing on CPU 202 of computer 

55 104. 

Upon entering automatic scan mode, control program 220 
performs necessary initialization of data 221 and buffer 222 
at step 801. Because buffer 222 is part of a larger general 
purpose RAM 203, initialization requires allocation of a 

60 portion of RAM 203 to buffer 222. Buffer 222 will be 
allocated in a plurality of segments 301-312, each buffer 
segment holding a television signal segment from a short 
time period. This time period is "short" in relation to human 
perceptions and viewing time, In relation to the operation of 

65 a digital computer it must be sufficiently long to permit 
computer 104 to perform the steps shown in FIGS. 8A and 
8B. This time period may, for example, be in the vicinity of 
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2 seconds. Segment pointer 325 is initialized to a first of 
such segments. 

For monitoring and storing television signals in real time 
in accordance with the preferred embodiment, the number 
and size of segments in buffer 222 must be sufficiently large 5 
that an interval of the specified size can be captured. For 
example, if it is desired to capture an interval of television 
signal beginning 15 seconds before closed captioning data 
matching a set of search parameters is encountered, then 
buffer 222 must be sufficiently large to hold 15 seconds of 10 
digitized television signal. If each segment holds 2 seconds 
of televised signal, then buffer 222 should hold a minimum 
of 9 segments. One extra segment is needed to account for 
the fact that control program 220 is analyzing a segment 
previous to the one being currently recorded. Control pro- 15 
gram 220 allocates a buffer of appropriate size based on 
scanning parameters. 

Alternatively, in certain applications it may be desirable to 
record much larger intervals. For example, a viewer may 
wish to save an entire half-hour program if a set of search 20 
parameters is satisfied anywhere within the program. The set 
of search parameters may even require a count of frequency 
of occurrence of some condition, so that the program should 
be saved only if the condition is met a specified number of 
times. In this case, computer 104 may be unable to deter- 25 
mine that the television program should be saved until the 
transmission is nearly finished. Because this may require 
buffers of extremely large size, computer 104 could alter- 
natively save the entire television program in storage 105 
while it is being transmitted, analyze the closed captioning 30 
data as described herein, and delete the program from 
storage 105 after transmission of the program is complete if 
the specified conditions are not met. 

After the buffer and data initialization functions have been 35 
performed, control program 220 waits in a loop for the start 
time at step 802. The start time, i.e., the time to begin 
receiving and monitoring a television signal, is specified in 
a profile data structure. Multiple profile data structures may 
exist, each specifying a certain start time. While waiting at 4Q 
step 802, the control program repeatedly compares the 
various start times in the profile data structures with an 
internal clock. When the internal clock reaches the first start 
time, the control program exits the wait loop. If multiple 
profile data structures exist, control program 220 will peri- 45 
odically check whether the respective start time of each has 
arrived and respond appropriately; for brevity of illustration, 
this is not shown in FIG. 8A. 

To start monitoring and capture of video signals, control 
program 220 sends a channel select command to receiver/ 50 
tuner 101 over control/keyboard line 111 at step 803, The 
channel select command specifies a television channel to be 
monitored, the channel being the one specified in the respec- 
tive profile data structure containing the start time which has 
been triggered. Digital receiver/tuner 101 responds to the 55 
channel select command by tuning the specified channel and 
transmitting the tuned, demodulated television signal on 
analog signal line 112. At the same time, control program 
220 sends a command to video capture unit 207 to begin 
receiving video signals over line 114, and to write the 60 
digitized video signals into the current segment in buffer 222 
(as being pointed to by current segment pointer 325). 

If the profile specifies that multiple channels are to be 
scanned, control program 220 will command tuner 101 to 
cycle through the channels of interest, thus obtaining closed 65 
captioning text from multiple channels. Because the amount 
of closed captioning text is relatively small, and is intended 
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to be displayed on a television for a time interval which is 
relatively long compared to the time required for digital 
hardware to decode the closed captioning signal, it is pos- 
sible for a single tuner to obtain samples from multiple 
channels by cycling through the channels and decoding the 
closed captioning signal However, in this case it is not 
possible for the hardware shown in FIG. 1 to save the video 
signal from multiple channels simultaneously. In other 
words, multiple channel scanning is possible, but not mul- 
tiple channel saving of video. If all item of interest is found, 
video from that channel can be saved upon detection of the 
match with the search parameters specified in the profile. 
Depending on the application, this small delay to start saving 
the video segment may be acceptable to the viewer. In the 
multiple channel hardware alternative embodiment 
described more fully below, control program 220 will com- 
mand the appropriate tuning hardware to monitor the speci- 
fied multiple channels, enabling multiple channel to be 
saved. 

Computer 104 simultaneously captures the current video 
segment and analyzes the previous video segment. These 
concurrent processes are illustrated in FIG. 8A by the 
divergent lines of flow going to blocks 804 and 810. As 
represented by block 804, video capture unit 207 receives 
the demodulated analog television signal from tuner 101 and 
splitter 102 over line 114. Capture unit 207 converts this 
signal to digital form, and transmits the digitized signal data 
over bus 201 to buffer 222. Data is preferably transferred in 
a direct memory access (DMA) operation requiring no 
intervention by CPU 202, as is known in the art of computer 
architecture. Because video capture unit 207 receives tele- 
vision signals in real time, it can not write data to buffer 222 
any faster than the data is received over line 114. A 2-second 
television segment requires 2 seconds for capture unit 207 to 
receive and write to buffer 222. While this is a relatively 
short interval in terms of human viewing time, it is more 
than long enough for a computer to perform the steps shown 
in blocks 810-828. These steps are performed by control 
program 220 executing on CPU 202 while video capture unit 
207 captures the signal. 

As depicted by block 810, control program 220 first 
fetches the closed captioned digital text stream associated 
with the previous segment of video. This is the text stream 
extracted from the closed captioning portion of the televi- 
sion signal by closed captioning text decoder 103. This text 
stream is transmitted by decoder 103 to computer 104 over 
serial line 115. Serial communications controller 206 
handles communication of data over line 115, Received text 
is saved in a log record (not shown) in storage 105, having 
timestamps or other means to correlate the received text to 
a particular video interval from which it came. Additionally, 
the most recent text will be required for analyses. Because 
the amount of closed captioning text contained in a typical 
video interval is relatively small, the recent text required for 
analysis may he stored in a small buffer (not shown) in 
controller 206, or in a section of memory 203. Where 
multiple channels are being scanned, a separate text log and 
temporary buffer would be required for each channel being 
scanned. 

Control program 220 next analyzes the text stream(s) with 
respect to the active profile(s) at step 811. Step 811 is broken 
out in greater detail in FIG. 8B, as described below. 

Referring to FIG. 8B, control program 220 compares a 
logged in text stream against the parameters of a profile to 
determine whether the text stream matches search criteria 
specified in the applicable profile at step 820. In the pre- 
ferred embodiment, the search criteria comprises one or 
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more keywords connected by logical relationships. The satisfy the logical. AND condition). The words in the closed 

steps required to form a determination as to whether a match captioning text must be within the proximity limit specified 

exists are represented in FIG. 9. in proximity field 441 of ANDed keyword block 440. 

Referring to FIG. 9, a determination whether a match Control program 220 therefore obtains each keyword in turn 

exists is made by scanning each keyword in an ORed 5 &om the conjunctive string (step 910), scans the P most 

keyword block 430 or ANDed keyword block 440 for a re f n u l words of the closed captiomng log to determine 

, . * . .tt j . , f c ! , ... , j whether a match exists, where P is the proximity limit 

match against each word in the log of closed captioning text med m fidd m ( m) ^ ^ 

Words in the log of closed captioning text are selected & ds m ^ s ( d have been co d t0 

serially for matching at step 901. Control program 220 th c log (step 912). If any keyword fails to match a word in 

accesses profile control block 401 to obtain the keyword i° the log at step 911, the conjunctive string as a whole does not 

block at the head of the first conjunctive string (the various match the log and control program proceeds to step 906 to 

conjunctive strings of keywords being ORed together to determine whether any additional conjunctive strings remain 

form disjunctive stnngs) at step 902. Referring to the to be analyzed. If all keywords in the conjunctive string are 

example of FIG. 5, ORed keyword block 520 is the first compared to the log at step 911, and a match is found for 

keyword block obtained. Control program 220 obtains the 15 each one, then the "N" branch from block 912 will be taken 

keyword from the appropriate keyword block for matching at the end of the string, and control program returns with a 

at step 903. In this example, keyword "Minnesota" is determination that a match of closed captioning text with 

obtained the first time through the loop. search parameters has been found. 

At step 904, control program compares the keyword If contro1 program 220 following the logic depicted in 

obtained from the appropriate keyword block with the 20 mG 9 determines at block 820 that no match exists, it then 

current word in the log of closed captioning text to deter- checks at ste P 821 whether a malch fla S * set on * ^ match 

mine whether the two words match. A "match" does not fia S indicates mat a match has been found in a previous 

necessarily mean each character of the two words is iden- receD ' l * > ^ ™ th f m ^ Iumt ? ° ^\^f f 

tical. The keyword may optionally contain wildcard char- Rifled m mterval field 404 of profile con rolb ock 401. If 

* u a *u r * t_ i 25 the match flag is off, there has been no match of the search 

acters to broaden the scope of matches. For example, a - ' . . , , . 

•,j j l. . < . . . parameters m any recent segment, and control proceeds to 

wildcard character such as #• may be used to indicate a block 822 or 823. If the match flag is on, the segment being 

variable number of letters of any kind. Such a wildcard anal d must be saved> and conUol ^ tQ block m 

character would normaUy be attached to a root word in order If comrol 22Q determines al b]ock 820 

to match on the root and any variant of the root. For (following the logic depicted in FIG. 9) that a match exists, 

example, a keyword of truck#" would detect a match not it then ^ a match timer (Q the interyal k h ified ia 

only for a ogged word of truck' , but also for "trucks", interval field 404 of ofile control Wock 401 at st ^ 

trucked , "trucking", "trucker", etc. Use of such wildcard ^ match timer k ^ regardless of whether the timer is 

characters is known in the art of computer database search- current ly active. The control program then checks the status 

mg * 35 of the match flag at step 831. If the match flag is off, no 

If the keyword and the current logged word being ana- m atch has been found within the time specified by the 

lyzed do not match, control program 220 then determines interval. In this case, it is necessary to first save all earlier 

whether there are any additional keywords in the conjunc- segments within the interval specified by interval field 304 

tive string at step 905. If so, control program 220 loops back which have not already been saved. Control program first 

to step 903 to get the next keyword in the string. In the 4Q se ts the match flag on at step 836. It then scans all earlier 

example of FIG. 5, control program 220 would fetch the segments currently in the buffer and recorded within the 

keyword "Twins" from ANDed keyword block 521. When interval to identify which ones are not "marked", and 

all the keywords of a single conjunctive string (e.g., blocks commands storage controller 210 to save all such segments 

520 and 521) have been compared to the current logged in storage 105, at step 837. Control program 220 then marks 

word, control passes to block 906. ^ aU segments it has identified to be saved by setting save flag 

At step 906, control program 220 determines whether field 322 at step 838. The purpose of marking segments is so 

there are any more conjunctive strings of keywords to that they are not saved again. Control then proceeds to block 

compare against the current logged word. If so the control 832. 

program loops back to step 902 to get the head of the next Storage controller 210 has direct memory access capabil- 

conjunctive string, and proceeds through blocks 903-905 to 50 ity. In response to a command from control program 220 to 

compare each keyword of the string to the current logged store a segment issued at step 837, controller 210 indepen- 

word. In the example of FIG. 5, blocks 522 and 523 dently and asynchronously retrieves the specified segment 

constitute the next conjunctive string. from buffer 222 and stores it in storage 105. Once control 

When all conjunctive strings have been compared against program 220 has issued the command to storage controller 

the current logged keyword, control program proceeds to 55 210 to store the segment, control program 220 need no 

step 907 to determine whether any more words from the log longer supervise the operation, and may continue processing 

of closed captioning text remain to be compared to the on the assumption that the segment will be stored in parallel 

keywords. If so, the control program loops back to step 901 with further processing in CPU 202. 

to get the next word in the log. When all words in the log If at block 831, the match flag is on, control program 220 

have been analyzed without finding a match, control pro- 6 o has detected a second match within the intervals. In this 

gram 220 returns with a determination that no match has case, it is presumed that the control program has already 

been found. caused storage controller 210 to save those segments earlier 

If, while traversing the keyword blocks, control program than the segment being analyzed ("previous" segment). 

220 determines at step 904 that any current logged word Accordingly, steps 836-838 are not performed, at control 

matches a keyword, it must then determine whether all the 65 flows directly to block 832. 

keywords in the same conjunctive string are matched by Block 832 is reached because the match flag is on, 

some word in the log of closed captioning text (in order to indicating that the segment being analyzed, i.e. the previous 
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segment, should be saved to storage. In this case, control may edit the television program by using any of various 

program 220 issues the appropriate command to controller conventional editing techniques. 

210 to save the previous segment at step 832, and then sets when operating in search/edit mode, video presentation 

save flag 322 to mark the previous segment at step 833 so S y St em 100 must first extract and build strings of text 

that it will not be saved again. 5 decoded from the closed captioning stream at step 1001. 

At block 834, control program 220 checks to see whether This may be done in a variety of ways. In one option, the 

the match timer has timed out, indicating that the time closed captioning stream can be decoded and saved as 

specified in interval field 404 has elapsed since the last strings of text simultaneously with the reception and storage 

match of the search parameters was encountered. If the timer of a broadcast television transmission. The stored television 

has timed out, the match flag is reset (set to 'off') at step 835, 10 program is later edited in search/edit mode. In a second 

so that no further segments will be saved unless another option, a recorded program can be scanned from beginning 

match of the search parameters is encountered. Control then to and to extract and decode the closed captioning stream, 

proceeds to block 822 or 823. building the strings of text. This step could be performed by 

Block 822 is applicable only if multiple channel scanning foe video presentation system without the need for the 

is in effect. In this case, control program 220 will return to 15 viewer to be monitoring the process, so that even if it 

block 820 to perform steps 820-1 and 830-8 for each channel requires playing the entire program from start to finish, the 

specified in the profile, if more than one channel is being viewer is freed from the tedious task of monitoring. This 

monitored. A separate match flag and timer will exist for second option would be useful, e.g., for scanning a pre- 

each channel being monitored. When the text streams from recorded videocassette. In a third option, the extracting and 

all channels have been analyzed, control proceeds to block 20 decoding of the text stream could be performed in small 

823. segments, concurrently with the other steps shown in FIG. 

At block 823, control program 220 will return to block 10 ™ s °^ on would be feasiMe onl y where the video 

820 to repeat steps 820-2 and 830-8 for each separate profile. S1 & sal > B stored in a format which permits rapid access to the 

When all profiles have been analyzed, control returns to dosed ca P tioDin g data without the need to play back the 

block 813 of FIG. 8 A. 25 catire v i deo presentation in real time (e.g. where it is stored 

At block 813, control program 220 checks an internal m digital format )- 

system clock to determine whether the time specified in time 0nce the text strings have been built from the closed 

end field 413 has passed. This time indicates the end of the captioning data stream, control program 220 executing on 

scanning period. If the time has passed, control program 220 30 cpu 202 attempts to match each text string with the 

exits scanning mode and returns to the main control loop keyword search parameters specified by an appropriate 

shown in FIG. 6. Where more than one profile is active and profile control block 401 at step 1002. This matching step is 

being used in the scan, scanning will end for each profile essentially the same as that performed when in automatic 

independently, so that control program does not return from scan mode > and shown ln FIG. 9. If a match is detected 

scan mode until the last time specified in any profile. If the 35 1003 )> CODtro1 program 220 causes storage control 210 to 

time has not yet passed, control program "increments" the retrieve a segment of video at which the match was detected 

segment pointer at step 814. It then issues a command to from storage 105, and display the video segment on monitor 

video capture unit 207 to place the next segment (after the (step 1004). 

current segment) of digitized video in buffer 222 at the At this point, the video presentation system has identified 

location pointed to by the segment pointer at step 815. 40 a video segment of interest to the viewer, and displayed it on 

Control program then waits at step 816 until video capture monitor 106. The viewer will then be offered a plurality of 

unit 207 is done decoding and storing the current segment in editing options at step 1005. The viewer may interactively 

the buffer. When capture Unit 207 is done with the current select one or more editing options using the keyboard or 

segment, control program loops back to block 810 and mouse, These potential choices are depicted in block 1006, 

begins processing the segment which capture unit 207 has 45 it being understood that the list of enumerated choices is not 

just decoded and placed in the buffer. necessarily exhaustive. For example, if the television pro- 

Typically, automatic scan mode as depicted in FIGS. 8A S ram ^ being scanned for the purpose of removing offensive 

and 8B will be used to scan and record short segments of language and/or scenes, the person editing the program may 

interest for later viewing. When the viewer is ready to view w ish t0 delete audio, to dub audio, or to delete audio and 

the saved segments, he merely commands video presenta- 50 v * de0 P ortioas of foe signal. If the editor is creating a new 

tion system 100 to play the segments on television monitor program using a variety of scenes from old programs, he 

106. To play the stored segments, presentation system 100 mav C0 P V tne video and/or audio portions of the signal to 

retrieves the saved segments from storage 105, converts the some s P ace m storage allocated for the new program. The 

stored digitized signal to an analog television signal with editing functions of deleting, copying, inserting, and 

display driver 208, and transmits the analog television signal 55 dubbing, applied to either video or audio portions of the 

via signal line 116 to tuner 101 and ultimately to monitor signal, are preferably offered to the user. Such editing 

106. During playback, the audio portion of the stored functions are known in the art. 

digitized television signal is converted to analog by audio When the person performing the editing has completed 

driver 209 and output on speaker 107. any editing of a video segment that has been located by 

Video presentation system 100 of the present invention is 60 control program 220, the control program determines 

further capable of operating in a search/edit mode, as whether additional text strings remain to be analyzed at step 

depicted in FIG. 10. Unlike automatic scan mode, search/ a nd if so loops back to step 1002 to scan the next text 

edit mode is intended as an aid to manual editing of the string. When all strings have been analyzed, the search/edit 

signal. Specifically, search/edit mode uses techniques simi- function is complete. 

lar to those used in automatic scan mode to scan a television 65 In the preferred embodiment, an interval is identified and 

program and locate segments that the viewer may wish to saved when there is only a single match with the search 

edit. Once these segments have been located, the viewer parameters. However, it would alternatively be possible to 
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require a minimum number of matches with the search A separate buffer 222 is required for each channel being 

parameters over an interval. This may be particularly useful scanned in the multiple channel alternative embodiment, 

for identifying longer video intervals, e.g., identifying entire This need may require a larger memory 220 than would be 

television programs or movies. As will be appreciated by required in the single channel preferred embodiment. A 

those skilled in the art of computer programming, it would 5 separate segment pointer 325 is required for each buffer, 

be relatively simple to maintain a count of the number of which means that at step 814 control program 220 must 

matches found and identify an interval of television presen- increment each segment pointer, and send a separate com- 

tation as one of interest only if the count exceeds some mand to each video capture unit at step 815. 

specified number. It will be further understood by those The profile data structures required to support multiple 

skilled in the art of computer database searching that the 1Q channel scanning have already been described and shown in 

specification of search parameters could be varied from the FIGS. 4A-4E. Thus, a single channel block 420 exists for 

simple "AND" and "OR" logical relationships of the pre- cac h channel to be scanned. Since channel blocks contain 

ferred embodiment. For example, additional logical opera- next channel pointer field 421, a chain of channel blocks of 

tors such as "NOT" could be added; variations of root words indefinite length can be specified, enabling the specification 

could be searched, etc. of mu iti p le channels. 

A preferred embodiment has been described in which the A ferred embodiment of this invention has been 

hardware is capable of receiving . television signals from and dcscribcd ab ^ ^ attcntion to haxdware CQm . 

scanning a single channel at a time. However, m an alter- ms and subassem £ lies available in the com . 

native embodiment, it is possible to receive and scan mul- ^ . . . . T . . ., . / , .„ , . 

tiple channels simultaneously, In this multiple channel alter- mercial mark u et !t 15 thus ^ lb }f for one sklUe ^ m * hc art 

native embodiment, it will be possible to save video from 20 t0 construct the svstem described herein from such hardware 

multiple channels simultaneously, and thus the full advan- components. However, in an alternative preferred 

tages of scanning numerous broadcasts for information of embodiment, it would be possible to construct the system 

interest in accordance with the present invention can be described herein as a single integrated unit. In this alterna- 

realized, at some cost in additional hardware. tive embodiment, the components shown in FIG. 1 which 

To support the multiple channel scanning embodiment, all 25 make U P svstem 100 are not necessarily physically separated 
hardware must be capable of servicing the increased require- units, but some may exist on a common circuit card, 
ments. The bus 201, CPU 202, storage controller 210 and Additionally, in this alternative embodiment, computer sys- 
storage 105 should be capable of multiplexing between tern 104 would not necessarily be a general purpose corn- 
processing data from different channels simultaneously. P uler system, but may be a special purpose computer dedi- 
However, separate tuners 101 and video capture units 207 30 cated 10 the functions of the presentation system described 
may be required. Additionally, separate closed captioning herein. For example, such a system may have only one 
decoders 103 may be required. The need for separate com- program it is capable of executing, which may be stored in 
ponents to handle each channel being scanned would depend a permanent read-only memory (ROM). It is expected that 
on the speed of the device selected, its ability to buffer data, # such a presentation system were to be mass-marketed and 
etc. It is anticipated that as the speed of electronic devices 35 used by viewers unfamiliar with computer operating 
improves and costs decline, the multiple channel alternative systems, such an integrated unit having a dedicated program 
embodiment will become more attractive. It is\further antici- would be preferable to the system having separate 
pated that as a result of closely integrating the various components, including a general purpose computer, as 
components, it may be necessary to duplicate only small described in the first preferred embodiment, 
portions of the hardware (such as the tuner) to achieve 40 In the preferred embodiment, the textual stream carried in 
multiple simultaneous channel scanning. However, it is the closed captioning data portion of the vertical blanking 
possible to construct the multiple channel embodiment using interval is used as a source of information to be matched 
hardware currently available by simply duplicating sufifi- with the search parameters. The closed captioning data is 
cient hardware. Since bus 201 available on standard per- used in the preferred embodiment because it has been 
sonal computers may be insufficient to handle the volume of 45 adopted as a standard within the United States. However, in 
data involved in multiple channels, this may require that an alternative embodiment, it would be possible to transmit 
computer 104 itself be duplicated, in addition to tuner 101, other data in the vertical blanking interval or other portion 
splitter 102, decoder 103, etc. of the video signal for decoding and extracting information. 

In the multiple channel scanning embodiment, control With regard to alternative sources of the text stream, it 
program 220 executes the same steps shown in FIGS. 8A 50 would in particular be possible to employ a speech recog- 
and 8B with respect to a single channel scanning embodi- nition device to extract speech from the audio component of 
ment. However, multiple video signals from multiple chan- the signal and convert this to a digital text stream, as shown 
nels are simultaneously converted to digital and written to in FIG. 1 as optional item 130. While speech recognition 
buffer 222. Thus, block 804 of FIG. 8A may be thought of unit 130 is shown in FIG. 1 as an independent, stand alone 
as being repeated multiple times in parallel, one for each 55 unit, it should be understood that speech recognition capa- 
channel being received and converted to video. The appro- bility could be provided by a card which plugs into an 
priate steps shown in FIG. 8B are performed separately by available slot in computer 104, or alternatively speech 
control program 220 for each channel being scanned. recognition could be accomplished via suitable software 
Because a match of the keyword search parameters is stored in memory 203 of computer 104 and executing on 
performed separately for each channel, there must be a 60 CPU 202. Many speech recognition devices are commer- 
separate match flag and match timer for each channel being cially available at the present time, although such devices 
scanned. As explained previously, control program 220 can may have limited vocabularies or accuracy. Even so, such 
normally complete steps 810-838 in much less time than it speech recognition devices could be used alone or in con- 
takes video capture unit 207 to receive and digitize a junction with closed captioning decoding to provide a text 
segment of video information. Therefore, there is ample 65 stream. 

time for control program 220 to serially perform the required As an example of such a use of a speech recognition 

steps separately for each channel being scanned. device, it is common for closed captioned text to contain 
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"simplified" or "watered-down" versions of the actual spo- 
ken text of the audio signal. In most cases, the information 
content is the same, so decoding of the closed captioning 
signal provides an adequate representation of the speech 
content. But for some purposes this is not true. Particularly, 5 
closed captioning text may water-down offensive language. 
Thus, where the present invention is being used as a cen- 
soring device to monitor offensive language, the concurrent 
use of a speech recognition device to generate additional text 
to be searched by control program 220 provides additional 
accuracy. Because the number of offensive words may be 
small, the limited vocabulary of commercially available 
speech recognition units is not necessarily a handicap. Of 
course, it is anticipated that as speech recognition devices 
achieve greater accuracy and speed, their use in the present 
invention may become more desirable. 15 

The video presentation system of the preferred embodi- 
ment is designed for use by a television viewer and for that 
reason includes functions such a viewer would typically 
desire. However, in any of various alternative embodiments, 
it would be possible to design special purpose devices 
having only some of the functional capabilities of the video 
presentation system of the preferred embodiment and/or 
being designed for different markets. For example, in an 
alternative embodiment a video editing facility could be 25 
designed having the search/edit function described herein, 
but without the automatic scan function. Such a video 
editing facility may, for example, be useful to a television 
producer to enable editing of television programs to be 
broadcast at a later time. In such an environment, the 30 
automatic scan function would probably be considered 
unnecessary. In other alternatives, the automatic scan func- 
tion could be present without the full range of editing 
capabilities of the search/edit function. 

In a further alternative embodiment, the video presenta- 35 
tion system of the present invention could be used in 
conjunction with a video library for accessing information 
from the library. In this alternative embodiment, a library 
would contain a large bank of video information for distri- 40 
bution. Distribution could be by physical means such as 
video cassettes, or by on-line means from mass storage such 
as CD-ROM. The present invention would be used as a 
library index for finding video material of interest in the 
video library. A typical library patron would define a profile 45 
indicating video of interest. This profile would by used in a 
similar manner to that of the profile described above and 
depicted in FIGS, 4A-4E, but may contain other fields 
helpful in searching from a video library. For example, the 50 
video library may have a system of classification, which 
could be used to narrow the scope of the search. The 
library's computer system, rising the profile defined by the 
library patron, would scan a closed captioning text stream 
for matches with the search parameters in the profile. This 55 
would require that, at the very least, the closed captioning 
signal be available on-line for scanning. When the system 
locates a segment of interest, the segment would preferably 
be displayed to the library patron on a video monitor, and the 6Q 
patron could then decide whether the video selection from 
which the segment is taken is of interest. 

Although a specific embodiment of the invention has been 
disclosed along with certain alternatives, it will be recog- 
nized by those skilled in the art that additional variations in 65 
form and detail may be made within the scope of the 
following claims. 



What is claimed is: 

1. An apparatus for facilitating the use of a video 
presentation, comprising: 

means for receiving a transmitted composite data signal, 
said transmitted composite data signal being comprised 
of a plurality of component data signals that represent 
said video presentation, at least one of said plurality of 
component data signals comprising, at least in part, 
digitized text; 

means for specifying information content of interest to a 
user of said video presentation; 

means for interpreting said digitized text into a text 
stream, said text stream representing information about 
said video presentation but not predefined 
characterization^) of said video presentation; 

means for searching said text stream for occurrences of 
text representing said information content of interest to 
a user of said video presentation; and 

means for extracting one or more video segments from 
said transmitted composite data signal, each of said 
segments corresponding to an occurrence of text that 
corresponds to said segment and representing said 
information content of interest. 

2. The apparatus for facilitating the use of a video 
presentation of claim 1, wherein said means for specifying 
information content of interest to a user comprises means for 
specifying one or more key words, and wherein said means 
for searching said text stream comprises means for searching 
said text stream for occurrences of said one or more key 
words. 

3. The apparatus for facilitating the use of a video 
presentation of claim 2, wherein said means for specifying 
information content of interest to a user comprises means for 
specifying a plurality of key words, linked by one or more 
logical relationships. 

4. The apparatus for facilitating the use of a video 
presentation of claim 1, wherein said means for interpreting 
said digitized text comprises means for extracting textual 
data from information carried in a vertical blanking interval 
of said transmitted composite data signal. 

5. The apparatus for facilitating the use of a video 
presentation of claim 4, wherein said means for interpreting 
said digitized text comprises: 

means for extracting a closed captioning signal from said 

transmitted composite signal, and 
means for interpreting said closed captioning signal into 

said text stream. 

6. A method for locating video data, comprising the steps 

of: 

inputting to an automatic locating device one or more 
search parameters representing information content of 
interest; 

interpreting digitized text into a text stream said digitized 
text being at least a portion of one of a plurality of 
component data signals that make up a composite data 
signal, said composite data signal representing a video 
presentation, said text stream representing information 
about said video presentation but not predefined 
characterization^) of said video presentation 

automatically searching, with said automatic locating 
device, said text stream for occurrences of text match- 
ing said one or more search parameters; and 

identifying one or more segments of said video 
presentation, each said segment corresponding to an 
occurrence of text derived from said segment and 
matching said one or more search parameters. 
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7. The method of claim 6, wherein said step of interpret- 
ing digitized text comprises extracting textual data from 
information carried in a vertical blanking interval of said 
composite data signal. 

8. The method for locating video data of claim 6, wherein 5 
said one or more search parameters comprise one or more 
key words. 

9. The method for locating video data of claim 8, wherein 
said one or more search parameters comprise a plurality of 
key words, linked by one or more logical relationships. 10 

10. An apparatus for editing a video presentation, said 
video presentation comprising a plurality of images intended 
for sequential display, said apparatus comprising: 

a video storage for storing said video presentation; 

a text derivation device for deriving a stream of textual 15 
data from said video presentation, said textual data 
representing information being conveyed by said plu- 
rality of images, but not predefined characterization(s) 
of said video presentation; 
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means for specifying one or more search parameters, said 
search parameters representing information contained 
in some portion of said video presentation; 

means for searching said stream of textual data for 
occurrences of textual data matching said one or more 
search parameters, each of said one or more search 
parameters comprising one or more key words; 

means, responsive to said searching means, for identify- 
ing one or more images represented by textual data 
matching said one or more search parameters; 

means for displaying said images identified by said iden- 
tifying means to an operator of the editing apparatus; 
and 

means for interactively editing said displaying images. 

11. The video editing apparatus of claim 10, wherein said 
one or more search parameters comprise a plurality of key 
words, linked by one or more logical relationships. 

***** 
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